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Abstract of WO0045229 

An apparatus and method for enabling an 
uncalibrated, model independent controller for a 
mechanical system using a dynamic quasi- 
Newton algorithm which incorporates velocity 
components of any moving system parameter(s) 
is provided. In the preferred embodiment, 
tracking of a moving target (40) by a robot (10) 
having multiple degrees of freedom is achieved 
using an uncalibrated model independent visual 
servo control. Model independent visual servo 
control is defined as using visual feedback to 
control a robot's servomotors without precisely 
calibrated kinematic robot (10) model or camera 
(36) model. A processor (17) updates a Jacobian 
and a controller (14) provides control signals 
such that the robot's end effector (34) is directed 
to a desired location relative to a target (40) on a 
workplece (38). 
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embodiment, tracking of a moving target (40) by a robot (10) having multiple degrees of freedom is achieved using an uncalibrated 
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UNCALIBRATED DYNAMIC MECHANICAL 
SYSTEM CONTROLLER 

CLAIM OF PRIORITY 

This application claims priority to, and the benefit of the filing date of, 
copending U.S. provisional application entitled, "Dynamic Quasi-Newton Method for 
Uncalibrated Visual Servoing," having sen no. 60/11 7, 829, filed January 29, 1999, 
which is entirely incorporated herein by reference. 

TECHNICAL FIELD 

The present invention is generally related to an uncalibrated, model 
independent controller for a mechanical system and, more particularly, is related to a 
system and method employed by a robot in visual tracking of a moving target. 
BACKGROUND OF THE INVENTION 

Control of mechanical systems by a computer, in the prior art, is typically 
based on a model of the mechanical system which relates controller inputs (sensor 
data) to the controller outputs (variables controlled by the computer). One example of 
a mechanical system controller is the cruise control apparatus of a car. Here, the 
controller input variable for the cruise control apparatus is the speed of the car as 
sensed by a tachometer, a speedometer, or the like. The detected speed of the car, or a 
representative parameter such as an error signal, is input into the controller computer. 
Based on whether the car must accelerate or decelerate, the controller computer 
initiates a control action (controller output variable), such as depressing the gas pedal 
more to initiate an acceleration of the car. 

For prior art, the key to controlling any mechanical system is the accurate 
modeling of the mechanical system that relates the controller inputs (sensor data) to 
the appropriate setting of the controller outputs. Models of a mechanical system have 
been traditionally developed in one of two ways. The first prior art method is to 
construct the mechanical system model using analytical techniques. This method 
involves mathematical modeling of all the system parameters and physical 
parameters. While this method is clearly the dominant prior art modeling method, 
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several significant problems arise. First, the model of the mechanical system is only 
as good as the data used to construct the model. Thus, if the measurements of the 
physical dimensions of the mechanical system are not extremely accurate, the model 
will not be valid. In the world of mass production, this means that parts must be 
5 constructed very accurately in order to duplicate the mechanical system upon which 
the controller model is based upon. A slight difference between one part of the 
product and the mechanical system model could render the entire controller model 
invalid for the product in which that part is used. Additionally, if any parameter in the 
system changes over time, then the model may no longer be valid. Any time a model 

10 no longer accurately represents the mechanical system, the controller computer will be 
incapable of performing as desired. 

Another more recent prior art modeling technique for deriving a model of a 
mechanical system involves the use of neural networks and/or fuzzy logic to construct 
the relationship between controller inputs and outputs. The appeal of this second 

15 approach is that some of the measurement errors that frequently plague the first 
modeling method can be avoided. The actual construction of the input/output 
relationship varies slightly between the neural network and the fuzzy logic modeling 
methods. For neural networks, a training period is required to construct the proper 
relationship between the input and output variables. This training period can involve 

20 a rather lengthy period of time because of the inputting of various levels of system 
inputs and the recording the sensor data. After the neural network system performs 
sufficient tests over the entire range of input and output variables, the computer 
controller can construct the appropriate mechanical system model. 

Developing a controller model of a mechanical system using fuzzy logic 

25 requires a person knowledgeable in the mechanical system. The person must 
construct the fuzzy sets and derive the correct relationships in order for the controller 
to function properly. The time and cost necessary for such a highly skilled person to 
develop the necessary fuzzy logic algorithms and computer control code is often 
prohibitive. 
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As with the first modeling technique, models based upon either neural 
networking or fuzzy logic become invalid if any mechanical system parameter should 
change with time. In such a case, the neural networking and fuzzy logic controllers 
must be retrained in order to work properly. 
5 As a further illustrative example of a mechanical system, a simple robot is 

considered in detail. Robotic technology is a fast paced changing art allowing each 
new generation of robots to perform tasks of ever-increasing difficulty. Some 
advanced robots employ a dynamic look-and-move method which allows a robot to 
position its end-effector relative to a target on a workpiece such that the robot can 

10 complete a predetermined operation. The robot's end-effector may be a tool, such as 
a cutter or a gripper, a sensor, or some other device. An end-effector is typically 
located on the distal end of a robot arm. The workpiece is the object of the robot's 
predetermined task. A target is a predetermined reference point on or near the 
workpiece. For example, a robot may have an arm holding a paint sprayer (end- 

1 5 effector) for spray painting (predetermined task) an automobile (workpiece). 

If the workpiece is moving, such as when the above-described automobile is 
travelling down a continuously moving assembly line, the robot's predetermined task 
becomes considerably more complicated. Tracking of moving targets with cameras is 
known in the art. However, these prior art control methods are model based and 

20 require a precise kinematic model of the robot and the camera system geometry. That 
is, control algorithms directing movement of the robot members through controlled 
couplers, such as a joint, screw or the like, must have a detailed model of the 
relationships of each member of the robot, each coupler of the robot, and the robot's 
end-effector. Also, the control algorithm requires a precise model of the relationship 

25 between the robot, the camera and the workpiece. An algorithm based upon a camera 
and servo control of the controlled couplers is known as a visual servoing algorithm. 

Before the robot can begin its predetermined task, all necessary reference 
locations must be calibrated. That is, the initial position of the robot's end effector, 
members and controlled couplers must be determined. Also, the position of the 
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workpiece and the associated target must be determined. All reference locations must 
be calibrated to the camera position. If any of the above described elements are not in 
the proper initial position, algorithms must be recalculated or the out-of-position 
element must be moved into its predetermined location. For example, the workpiece 
5 may have to be placed into a jig and the jig positioned at an mitial starting position. 
Also, any movement or relocation of the camera will cause errors because reference 
locations will not be properly mapped into the visual servoing algorithm. 

Development of a model independent approach for robotics control has been 
considered. The model independent approach describes visual servoing algorithms 

10 that are independent of hardware (robot and camera systems) types and configuration 
of the working system (robot and workpiece). The most thorough treatment of such a 
method has been performed by Jagersand and described in M. Jagersand, Visual 
Servoing Using Trust Region Methods and Estimation of the Full Coupled Visual- 
Motor Jacobian, lASTED Applications of Robotics and Control 1996, and in M. 

15 Jagersand, O. Fuentes, and R. Nelson. Experimental Evaluation of Uncalibrated 
Visual Servoing for Precision Manipulation, Proceedings of International Conference 
on Robotics and Automation, 1997. Jagersand formulates the visual servoing problem 
as a nonlinear least squares problem solved by a quasi-Newton method using Broyden 
Jacobian estimation. That is, tracking a moving target is a predictive method 

20 employing a static based algorithm solving a series of static problems and equations. 
Jagersand demonstrates the robust properties of this type of control, demonstrating 
significantly improved repeatability over standard joint control even on an older robot 
with backlash. However, Jagersand's work focuses on servoing a robot end-effector 
to a static target. That is, the workpiece is not moving. 

25 Thus, a heretofore unaddressed need exists in the industry to address the 

aforementioned deficiencies and inadequacies. 

SUMMARY OF THE INVENTION 
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The present invention provides an apparatus and method for enabling an 
uncalibrated, model independent controller for a mechanical system using a dynamic 
quasi-Newton algorithm which incorporates velocity components of any moving 
system parameter(s). 

5 Briefly described, in architecture, a preferred embodiment enabling tracking of 

a moving target by a robotic system having multiple degrees of freedom using an 
uncalibrated model independent visual servo controller is achieved by the method and 
apparatus of the present invention, and can be implemented as follows. Model 
independent visual servo control is defined as using visual feedback to control robot 

10 servomotors without precisely calibrated kinematic robot models and camera models. 
A sensing system, such as a camera, detects the position of at least a target on a 
workpiece and a point on the robot, such as on the robot's end effector. The detected 
positions of the target and the point are converted by a processor into information 
used by the dynamic quasi-Newton algorithm of the present invention to calculate a 

15 translation model, hereinafter known as the Jacobian. A Jacobian specifies 
differential changes in the robot position per differential changes in the joint position 
of each joint (rotary or prismatic) of the robot. A controller send control signals, as 
specitied by the Jacobian calculated by the processor, to servomotors controlling the 
robot's rotating joints. With each subsequent update of the Jacobian, the position of 

20 the robot's members are adjusted such that the end-effector is directed to a desired 
location relative to the target. 

The above-described controller is equally applicable to controlling other types 
of mechanical systems. Because the controller does not require a kinematic model, 
the controller is particularly suited to mechanical systems having at least one moving 

25 parameter, or to mechanical systems for which a precise kinematic model is 
impractical or impossible to develop, such as when a parameter of the kinematic 
model is changing. Nor does the controller require a detailed model of the sensing 
system. For example, the camera of a visual tracking system can be repositioned or 
bumped without interrupting the tracking process or diminishing tracking accuracy. 
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Similarly, the sensor system may utilize different types of sensors, such as mechanical 
sensors, magnetic sensors, visual sensors, optical sensors, sonic sensors, temperature 
sensors, infrared sensors, force sensors, proximity sensors or the like. 

One object of the present invention is to enable a model independent controller 
S for controlling a mechanical system. 

Another object of the present invention is to enable a controller to control a 
mechanical system after a change in a system parameter. 

Another object of the present invention is to enable a controller to control a 
mechanical system after a change in a system parameter after a shortened retraining 
10 period. 

Another object of the present invention is to enable a model independent 
controller for tracking a moving target for use in a tracking system. 

Another object of the present invention is to enable a model independent 
visual servoing controller for tracking a moving target for use by a robot, 

15 Another object of the present invention is to enable an uncalibrated, model 

independent visual servoing controller for tracking a moving target for use by a robot. 
That is, the initial positioning of the robot end-effector, members and controlled 
couplers, or the initial positioning of the workpiece and the associated target, is not 
required. Also, exact positioning of the camera in a predetermined location is not 

20 required. The robot will effectively and accurately perform its predetermined task 
even if the camera is displaced or if the workpiece is not properly positioned on the 
moving conveyor belt. 

Another object of the present invention is to enable a model independent 
controller for tracking a moving target for use in a controller system which utilizes a 

25 sensor, or combination of sensors, such as but not limited to a mechanical sensor, a 
magnetic sensor, an optical sensor, a visual sensor, a sonic sensor, a temperature 
sensor, an infra-red sensor, a force sensor, a proximity sensor or other sensors as 
conunonly known in the art. 
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Other systems, methods, features, and advantages of the present invention will 
be or become apparent to one with skill in the art upon examination of the following 
drawings and detailed description. It is intended that all such additional systems, 
methods, features, and advantages be included within this description, be within the 
5 scope of the present invention, and be protected by the accompanying claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The invention can be better understood with reference to the following 
drawings. The components in the drawings are not necessarily to scale, emphasis 
instead being placed upon clearly illustrating the principles of the present invention. 
10 Moreover, in the drawings, like reference numerals designate corresponding parts 
throughout the several views. 

FIG. 1 is a diagram of a robot and workpiece system where the workpiece is 
moving along a conveyor. 

FIG. 2 is a controller block diagram of the preferred embodiment of the 
1 5 invention employing a dynamic quasi-Newton algorithm. 

FIG. 3 is a block diagram of an embodiment of the invention employing a 
dynamic quasi-Newton with a recursive least squares (RLS) algorithm. 

FIG. 4 is a block diagram showing the Jacobian estimation scheme of FIG. 3. 
FIG. 5 is a diagram of a one degree-of-freedom system used in testing the 
20 dynamic controller of FIG. 2. 

FIG. 6A is a graphical representation illustrating the tracking error of the one 
degree-of-freedom system of FIG. 5 using prior art control methods. 

FIG. 6B is a graphical representation illustrating the tracking error of the one 
degree-of-freedom system of FIG. 5 using control methods of the present invention. 
25 FIG. 7 is a diagram of a car speedometer which is controlled by an alternative 

embodiment of the controller. 

FIG. 8 is a diagram of a mechanical system having two cars separated by a 
distance which is controlled by an alternative embodiment of the controller. 
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FIG. 9 is a diagram of a robot and workpiece system where the robot is 
moving towards the workpiece. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
I. Description of a Preferred Embodiment 

FIG. 1 shows a mechanical system which includes a controller computer 14, a 
robot 10 and a workpiece 38. The robot 10 has a muUi-member robot arm 12 
connected to a controller computer 14 via a control cord 16. In the preferred 
embodiment, processor 17 resides within the controller 14, however processor 17 may 
reside in any convenient location outside of the controller 14. The robot 10, used to 
illustrate the method and apparatus of the present invention in a preferred 
embodiment, includes a pedestal 24, upon which the robot arm 12 is moxmted. The 
robot arm 12 has three members 18, 20, and 22. Member 18 is coimected to pedestal 
24 with a rotating joint 26. Residing within rotating joint 26 is a sensor, known as a 
joint resolver (not shown), which detects the angular position of the rotating joint 26. 
The angular position of rotating joint 26 is controlled by a servoing motor (not 
shown). The position of member 18 is known when the angular position of rotating 
joint 26 is determined. Controller 14 sends control signals to the servoing motor to 
adjust the angular position of rotating joint 26, thereby controlling the position of 
member 18. Member 20 is connected to member 18 by rotating joint 28. Member 22 
is connected to member 20 by rotating joint 30. Rotating joint 30 and rotating joint 
28 are controlled in a similar maimer as rotating joint 26. End-effector 34 is 
connected to arm member 22 by wrist joint 32. Wrist joint 32 may have up to three 
degrees of freedom of movement. The position of member 20, member 22 and end 
effector 34 is controlled by adjusting the angular position of their respective joints. 

A camera 36 views workpiece 38 positioned on conveyor 42. In this example 
system, workpiece 38 is moving on conveyor 42 in the direction shown by the arrow 
44. The camera 36 is viewing the target 40 located on the workpiece 38 and a 
predefined point 46 on end-effector 34. The image recorded by camera 36, which 
contains images of the target 40 and point 46, is transmitted to a processor 17 residing 
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in controller 14 via means commonly employed in the art, such as by cable (not 
shown), radio signals, infrared signals or the like. The image is converted by the 
processor 17 into pixels employing methods conmionly used in the art. Pixels 
associated with target 40 and point 46 are then marked and used as the points for 
5 reference necessary for the processing algorithm. The processing algorithm is then 
executed by the processor 17 to generate a translation model, or Jacobian. The 
Jacobian specifies differential changes in the robot position per differential changes in 
the angular position of rotating joints 26, 28, 30 and 32. Processor 17 provides the 
controller 14 control signals which are sent to the robot 10 such that the end-effector 

10 34 is directed to the desired location relative to the target 40. When the robot 10 end- 
effector 34 is properly positioned, the robot 10 can begin its predefined task. One 
having ordinary skill in the art will realize that processor 17 can reside at any 
convenient location and provide control signals to controller 14 using methods known 
in the art without departing substantially from the principles of the present invention. 

15 In a preferred embodiment an image-based visual servoing method, which can 

be classified as dynamic look-and-move method, is illustrated. In addition, the 
processing method is endpoint closed-loop (ECL), which is a method employing a 
vision system that views both the target 40 and the point 46 located on the end 
effector 34. One skilled in the art will appreciate that ahemative embodiments may 

20 detect the position of two points using any detection means or combination of 
detection means, such as but not limited to, mechanical sensors, magnetic sensors, 
visual sensors, optical sensors, sonic sensors, temperature sensors, infixed sensors, 
force sensors, proximity sensors or the like. Additionally, one skilled in the art will 
realize that alternative embodiments of the invention will perform equally well with 

25 an eye-in-hand method, or an endpoint open loop system, where the camera is 
mounted on the robot's end effector. 
IL Controller Block Diagram 

FIG. 2 shows the controller block diagram as applied to the robot 10 of FIG. 1 . 
Positions of rotating joints 26, 28 and 30, position of wrist joint 32, positioning of the 
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pedestal (if movable) and any other moveable connectors of the robot 10 (see FIG. 1) 
are calculated using a nonlinear least squares optimization method which minimizes 
the error in the image plane. The processing algorithm estimates the Jacobian on-line 
and does not require calibrated models of either the camera configuration or the robot 
5 kinematics. A Jacobian, for the robot embodiment, is the group of servo motor angle 
positions controlled by the controller 14 (controller outputs). Often, servo motor 
angle position information is grouped in a matrix format, or the like, to facilitate the 
mathematical representation and calculation of the controller outputs by the processor 
17. This means, for example, that the processing algorithm, hereinafter the dynamic 

10 quasi-Newton algorithm, provides a Jacobian (joint positions as servo motor angles) 
as reference inputs for the joint-level controllers. As system parameters change with 
time (work piece moving down the conveyor belt), the processing algorithms 
(dynamic quasi-Newton algorithm) incorporate the velocity of the changing 
parameters to calculate a Jacobian update (new joint positions) for the controller such 

15 that the robot can perform its predetermined task (moving the end effector to the 
target). 

Describing FIG. 2 in detail, the camera 36 captures an image which includes 
images of at least the target 40 and the point 46 on the end effector 34 (FIG. 1), as 
shown in block 210. The image is then processed by the processor 17 residing in 

20 controller 14, shown by block 212, to generate a datum point, y*, of the moving target 
40. An error signal /is generated at block 214 by subtracting datum point y* from the 
datum point y(9). The error signal contains rate of change information, such as 
velocity of the moving target 40 of FIG. 1. The Jacobian is updated by the processor 
at block 216 and joint angle positions are calculated at block 218. Control signals are 

25 sent to the robot 10 (FIG. 1) causing the robot 10 to adjust its position at block 220. 
The camera 36 captures the image of the new positions of point 46 and the target 40 at 
block 230. The processor 17 processes the image at block 240 to generate a datum 
point y(9). y(9) is passed to block 214 for processing as described above. 
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IlL Dynamic Ouasi-Ncwton Algorithm Defined 

The dynamic quasi-Newton algorithm, as described above, is now described in 
greater detail. For a moving target 40 (FIG. 1) at position y*(t), and point 46 of the 
end-effector 34 at position y(0), as seen in an image plane, the residual error between 
the target 40 and point 46 can be expressed as f (e,t) = ye-y*(t). The objective 
function to be minimized, F, is a function of squared error. 

^(e.O=|/'(e,0/(e,/) 

The Taylor series expansion about 9,/ is 

F(e+/%,f + /r,)=F(G,0+i^e'fe +^,/^,+... 
where Fe, F, are partial derivatives and /ig, h, are increments of G, /. For a fixed 

sampling period F is minimized by solving 



0 = F, + F^h,+F„h,+O(h^) 
The term o{h^ ) indicates second order terms where h, is absorbed into since it is 

assumed they are on the same order of magnitude. Dropping the higher order terms 
yields 

0 = F,+F^h,+F^h, 

K—iFj-'iF,+FM 
where the discretization = 9*+/ - 9^ is introduced. Equation (1) is referred to as the 

e*.,=9*-(Fee)-'(Fe+F^/«,) 0) 
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"dynamic" Newton's method. If the target is static, F is a function of 0 and = 0. 
This results in the "static" Newton's method, e^^, =Q^- (FJ ' (F^). 
Expanding the terms Fqq, and F^ 



Fqq = JIJ/i + Sjf 
Id k 

and substituting results in 



where 



and 



ae 



ae ae 

the Jacobian. To compute the terms 5 and J analytically would require a calibrated 
system model. The term S is difficult to estimate, but as e;^ approaches the solution, it 
approaches zero. Hence, it is often dropped (also known as the Gauss-Newton 
method). The convergence properties of a dynamic Gauss-Newton method are similar 
to the dynamic Newton method provided S is not too large. 

The Jacobian J can be replaced in the Gauss-Newton method by an estimated 

Jacobian, J , using Broyden estimation. The iteration then becomes a quasi-Newton 
method where the term S is set to zero. 



The convergence properties of a dynamic Gauss-Newton method are similar to the 
dynamic Newton method provided S is not too large. 
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The term 



5/(0 



is a rate of change term, where 



dy'it) ^ df{t) 



, such as the 



dt 



dt dt 



velocity of the target 40 (FIG. 1) in the image space viewed by the camera. Since 
only first order information on the target 40 is available from the vision information, 
velocity estimates are used. Broy den's method is a quasi-Newton method; the 
algorithm substitutes an estimated Jacobian for the analytic Jacobian based on 
changes in the error function corresponding to changes in state variables. The 
estimated Jacobian is a secant approximation to the Jacobian. As with Newton's 
method, the moving target scenario requires that the appropriate time function 
derivatives are included. A dynamic Broyden's method for a moving target scenario 
can be derived in a similar manner to the dynamic quasi-Newton' s method. However, 
for brevity the derivation is omitted here. 

Let Jf^ represent the approximation to J^. For this problem formulation, the 
Jacobian represents a composite Jacobian including both robot and image Jacobians. 
The Broyden update. A/ , for a static target scenario is given as follows. 



The proposed dynamic Broyden update contains an additional term, ^ h, , having a 

dt 

rate of change component. 




(6) 
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Notice that if the target stops moving, the term ^ = 0 , and the dynamic Broyden 

dt 

update term is identical to that for a static target. 

Incorporating the dynamic Broyden update above results in the following 
quasi -Newton approach, known as a dynamic Broyden' s Method, given by the 
following: 



Dynamic Broyden *s Method 

Given f: R"-» R"^; Bq, 9, € R"; Jo e R" 
Do fork-- 1,2 ... 

f - df(t) ^ T 
K dt J 



One skilled in the art will appreciate that the 



dt 



term, which represents a 



rate of change in the detected target location (velocity), may be multiplied by a scalar, 
may have an added constant, and/or may be further integrated, without departing 
substantially ifrom the principles of the method and apparatus of the present invention. 
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The term includes the velocity (rate of change) of the target, the 

ot 

velocity (rate of change or movement) of the end-effector and any movement or 
repositioning of the camera. For example, if the camera is accidentally bumped or 
intentionally repositioned during the target tracking process, the tracking process will 
not be interrupted and the tracking process will be successfully and accurately 
effected. 

IV. Recursive Least Squares Estimation 

Since the Jacobian update contains only information from the previous update, 
the algorithm may display instabilities in the presence of noise above some level. 
Greater stability can be achieved if the Jacobian estimation considers data over a 
period of time instead of just the previous iteration. The increased stability can be 
achieved using an exponentially weighted recursive least squares (RLS) algorithm. 

Equations for and Pi, define a recursive update for estimating Jf,. A dynamic quasi- 
Newton method using the RLS Jacobian estimation scheme follows. 



J 



A dynamic quasi-Newton method with a RLS estimation is shown below. 
Given / ^ JR^.-ee .9, e 9?". Jo e 9?""".Po ^ W'^A e (0,l) 

Do/or k= 1,2, ... 

A/ = /*-/,-, 
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Pk = - + tiPk-xh y [Pk-xK K Pk-x )) 

End for 

The RLS algorithm minimizes a weighted sum of the squares of the 
differences in each iteration for (9, t) = (9,_i,/,_i). The format is similar to the 
dynamic Broyden's method with the exception of X and P^. The parameter X can be 
tuned to average in more or less of the previous information. A X close to 1 results in 
a filter with a longer memory. The RLS algorithm may be used for system 
identification, particularly for visually guided control. One skilled in the art will 
realize that the above-described quasi-Newton method with RLS estimation will be 
equally applicable to other systems. The expected output from the previous iteration, 

Ji^1\ is compared with the desired signal A/ . This is multiplied by the 

dt 

gain and the product is used to update the Jacobian estimate. 

FIG. 3 is a block diagram 310 representing the dynamic quasi-Newton method 
with RLS estimation. Block 312 corresponds to the robot end-effector position. 
Block 314 corresponds to the target position. The target position is subtracted from 
the robot end-effector position at node 316 to determine an error value. Block 318 
provides a gain to the error signal and block 320 provides a gain to the target position, 
the output of blocks 318 and 320 are summed as shown at node 322 and sent to the 
Jacobian Estimation block 324. Additionally, the error value from block 316 is 
summed with the output of block 320 as shown at node 326 and sent to the dynamic 
quasi-Newton block 328. The output of the dynamic quasi-Newton block 328 is 
returned to the target position, block 314, for calculations for the next time period. 

FIG. 4 is a block diagram showing the Jacobian estimation 324 scheme of 
FIG. 3. The gain K is given below: 
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Summing node 412 sums the two values as shown in FIG. 4. Block 414 provides a 
gain to the output of node 412. Node 416 and block 418 provide a feedback lop as 
shown. Block 420 provides a final gain to the output of block 416. The output of 
block 420 is sent to the dynamic quasi-Newton block 328 (FIG. 3) and is sent back to 
node 412. 

One skilled in the art will realize that the RLS estimation is a special case of a 
Kalman filter. 

Derivations, theorems and proofs for the above mentioned dynamic quasi- 
Newton algorithm, dynamic Broyden Jacobian update and the RLS estimation are 
described in detail in the Ph.D. thesis paper entitled Dynamic Quasi-Newton Method 
for Model Independent Visual Servoing, by Jennelle Armstrong Piepmeier, Georgia 
Institute of Technology, Atlanta, Georgia, July 29, 1999, which is incorporated 
entirely herein by reference. 

V, Test Results of the Present Invention when Reduced to Actual Practice 

FIG. 5 shows a simple one degree-of-freedom (1 DOF) system that has been 
simulated to test the dynamic controller of the present invention and dynamic 
Broyden's update method. A target 540 is shown on a workpiece 538. An arm 510 
fixed to a controllable rotary joint 520 is located 400 millimeters (mm) from the 
midpoint of the target 540 motion. A sensory system, such as the camera 36 and 
controller 14 of FIG. 1, determines the position of the target 540 and where the arm 
510 crosses the line 560 of target 540 motion. No noise was added to the sensor data 
for this simulation. Error is measured as the distance between the arm 510 and the 
target 540 along the line of target motion. 

The target 540 is moving sinusoidally v^th an amplitude of 250nun at 1.5 
radians/second (rad/s) which results in a maximum speed of 375 millimeters/second 
(nmi/sec). The simulation is performed with a 50ms sampling period. Velocity state 
estimates are computed by first order differencing of the target 540 position. 
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FIG, 6A shows the tracking error 610 for a controller operating under a prior 
art static quasi-Newton method for the system of FIG. 3. FIG. 6B shows the tracking 
error 620 for a controller operating under a dynamic quasi-Newton method of the 
present invention for the system of FIG. 5. The error 610 for the prior art static quasi- 
Newton method in Fig. 4A appears chaotic, and contains spikes several orders of 
magnitude higher than the amplitude of the target 540 (FIG. 5) motion. The root 
mean square (rms) error for the prior art static quasi-Newton method in FIG. 6A is 
about 55mm. 

The steady-state error 620 using the dynamic quasi-Newton method of the 
present invention, shown in Fig. 6B, has an rms value of approximately 1mm. These 
results for a one degree-of-freedom system of FIG. 5 vsdth a controller operating under 
a dynamic quasi-Newton method of the present invention strongly validate the control 
law and dynamic Broyden Jacobian update of the present invention. 

The above-described one-dimensional sensor-based control example 
demonstrates a significant performance improvement for the tracking of moving 
targets using dynamic quasi-Newton method and dynamic Broyden Jacobian 
estimator for a 1-DOF manipulator. Similar success for visual servo control of a 6- 
DOF manipulator in simulation is described in detail in the above-mentioned IEEE 
proceedings paper, A Dynamic Quasi-Newton Method for Uncalibrated Visual 
Servoing, which is incorporated entirely herein by reference. 
VL Alternative Embodiments 

The dynamic quasi-Newton algorithm can be implemented in hardware, 
software, firmware, or a combination thereof In the preferred embodiment, the 
dynamic quasi-Newton algorithm is implemented in software or firmware that is 
stored in a memory and that is executed by a suitable instruction execution system. If 
implemented in hardware, as in an alternative embodiment, the dynamic quasi- 
Newton algorithm can implemented with any or a combination of the following 
technologies, which are all well known in the art: a discrete logic circuit(s) having 
logic gates for implementing logic fimctions upon data signals, an application specific 
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integrated circuit having appropriate logic gates, a programmable gate array(s) (PGA), 
a field programmable gate array (FPGA), etc. 

A dynamic quasi-Newton algorithm program, which includes an ordered 
listing of executable instructions for implementing logical functions, can be embodied 
in any computer-readable medium for use by or in connection with an instruction 
execution system, apparatus, or device, such as a computer-based system, processor- 
containing system, or other system that can fetch the instructions from the instruction 
execution system, apparatus, or device and execute the instructions. In the context of 
this document, a "computer-readable medium" can be any means that can contain, 
store, communicate, propagate, or transport the program for use by or in connection 
with the instruction execution system, apparatus, or device. The computer readable 
medium can be, for example but not limited to, an electronic, magnetic, optical, 
electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation 
medium. More specific examples (a nonexhaustive list) of the computer-readable 
medium would include the following: an electrical connection (electronic) having one 
or more wires, a portable computer diskette (magnetic), a random access memory 
(RAM) (magnetic), a read-only memory (ROM) (magnetic), an erasable 
programmable read-only memory (EPROM or Flash memory) (magnetic), an optical 
fiber (optical), and a portable compact disc read-only memory (CDROM) (optical). 
Note that the computer-readable medium could even be paper or another suitable 
medium upon which the program is printed, as the program can be electronically 
captured, via for mstance optical scanning of the paper or other medium, then 
compiled, interpreted or otherwise processed in a suitable manner if necessary, and 
then stored in a computer memory. 

Another alternative embodiment of a mechanical system controller employing 
the above-described processing algorithm is a car cruise control system. A car 
speedometer 710 is shown in FIG. 7. Here, the present car speed of 30 miles per hour 
(MPH) is indicated by the speedometer needle 712. If the desired speed is 40 mph, 
the car is required to accelerate until the desired 40 mph speed is reached. One skilled 
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in the art will realize that this simple control problem is actually quite complex. 
Many system parameters are constantly changing. Such changing parameters include 
the mass of the car (weight), surface of the road (flat, uphill or downhill), and power 
delivery capabilities of the motor and power train (transmission gear state, fuel 
consumption rate, etc.). Prior art methods have produced reasonably effective 
controllers for a car cruise control system which anticipates and accounts for many of 
these variable parameters. However, other non-variable parameters in the prior art 
models could change, such as a change in a speed sensor as the speedometer cable 
stretches and wears with time. Changes in these types of parameters could not be 
accounted for in a prior art mechanical system model. With the present invention, the 
car speed and the desired speed are the only two required controller inputs 
(mechanical system parameters) necessary for the computer controller. For example, 
the car speed could be sensed by the angular position of the speedometer needle 712. 
The desired speed could be specified using any method commonly employed in the 
art. A controller for a car cruise control system implemented by the processing 
algorithm would not be affected by changes in parameters modeled in the prior art 
controllers. 

Additionally, the above-described processing algorithm enables a controller 
which is applicable to other tracking systems. An example of another alternative 
embodiment is an automatic car spacing control system. Such a controller would be 
significantly more complex than the above-mentioned car cruise control system. A 
mechanical system 810 with two cars travelling on a road 811 is shown in FIG. 8. 
The objective of the controller is to ensure that a minimum distance, D 812, is 
maintained. D 812 is measured from the rear bumper 814 of the lead car 816 to the 
front bumper 818 of the following car 820. For this embodiment of the present 
invention, the control action would be deceleration of the following car 820 whenever 
the minimum distance, D 812, criteria is violated. Sensor 822 measures the actual 
distance between the front bumper 818 and the rear bumper 814. Such a sensor could 
be based on any one of a variety of sensing techniques commonly employed in the art. 
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such as infrared, microwave, radar, sound, vision or the like. A controller employing 
the apparatus and method of the present invention would sense the actual distance and 
adjust the speed of the following car 820 whenever the minimum distance, D 812, 
criteria is violated. A significant advantage of the controller is that a detailed model 
of the position of sensor 822 is not required. That is, the sensor could be disposed on 
the following car 820 at any convenient location. Also, since no mechanical system 
model is required, the controller would work equally well on any model, make or 
variation of any motorized vehicle. Furthermore, this embodiment of the controller 
would work equally well on any moving object, such as a boat, train, airplane or the 
like, particularly if the controller provided a warning indication coupled with the 
control action. 

The above-described controller is equally applicable to other types of robotic 
devices with at least one degree of freedom (DOF) in movement of an end effector. 
One such possible altemative embodiment would control a mobile robot when the 
workpiece position is fixed. FIG. 9 illustrates such a mechanical system having a 
mobile robot 910. Mobile robot 910 is similar in construction to the robot 10 of FIG. 
1. This altemative embodiment operates in a similar manner as the preferred 
embodiment of the present invention, except that workpiece 938 does not move. A 
pedestal 924 is mounted on a mechanized carriage 925, or the like. Elements in FIG. 9 
that are similar to those in FIG. 1 bear similar reference numerals in that reference 
numerals in FIG. 9 are preceded by the numeral "9". 

Processor 917 provides control signals to controller 914 based upon the 
images of the target 940 on workpiece 938 and the point 946 on end effector 934 
detected by camera 936. The predetermined task of moving end effector 934 to the 
workpiece 938 is accomplished by moving robot arm 912 members 918, 920 and 922 
(by adjusting the angular positions of joints 926, 928, 930 and 932) in a manner 
substantially similar to that in the preferred embodiment. Additionally, the mobile 
robot 910 is moved towards the workpiece 938 by repositioning the carriage 925 in 
the direction shown by arrow 944. 
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Using the above-described controller, a detailed model of the mechanical 
system shown in FIG. 9 is not required. Jacobian updates based upon the dynamic 
quasi-Newton algorithm would be similar to that of the preferred embodiment, and 
would include additional velocity components for the motorized carriage 925. 

VIL Variations and Modifications 

It should be emphasized that the above-described embodiments of the present 
invention, particularly, any "preferred" embodiments, are merely possible examples of 
implementations, merely set forth for a clear understanding of the principles of the 
invention. Many variations and modifications may be made to the above-described 
embodiment(s) of the invention without departing substantially from the spirit and 
principles of the invention. All such modifications and variations are intended to be 
included herein within the scope of this disclosure and the present invention and 
protected by the following claims. 
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CLAIMS 

Therefore, having thus described the invention, at least the following is 
claimed: 

1 . A method for calculating control data for controlling a first 
parameter of a system, comprising the steps of: receiving data that represents a 
measurement of said first parameter in said system; translating said data using 
at least rate of change information of said first parameter; and producing a 
translation model, wherein said translation model enables control of said first 
parameter so that said first parameter converges toward a predefined second 
parameter. 

2. The method of claim 1, wherein said translating step uses a dynamic 
quasi-Newton algorithm. 

3. The method of claim 1 , wherein said translation model includes a 
dynamic Broyden Jacobian update. 

4. The method of claim 1, wherein said translation model includes a 
dynamic recursive least squares Jacobian update. 

5. The method of claim 1, wherein said translation model is a linear 
mathematical Jacobian. 

6. The method of claim 1 , wherein said translation model is a non-linear 
mathematical Jacobian. 

7. The method of claim 1 , wherein said predefined second parameter is 
chosen from the group consisting of a distance, a specific location, a specific 



23 



wo 00/45229 



PCT/USOO/01876 



temperature, a temperature range, a specific pressure, a pressure range, a specific 
volume, and a volume range. 

8. The method of claim 1 , further comprising the step of producing at 
least one control signal for a controller, based upon said translation model, and 
without creating and using a kinematic model of said system. 

9. The method of claim 1 , wherein said translation model includes at least 
velocity information associated with said first parameter. 

10. The method of claim 9, wherein said velocity information is modified 
by addition of a number. 

1 1 . The method of claim 9, wherein said velocity information is modified 
by multiplication by a number. 

12. The method of claim 9, wherein said velocity information is modified 
by integration. 

13. The method of claim 9, wherein said system has a workpiece and a 
robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between an end- 
effector of said robot and a target point associated with said workpiece, and said rate 
of change information includes velocity information associated with said workpiece. 

14. The method of claim 9, wherein said system has a workpiece and a 
robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between an end- 
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effector of said robot and a target point associated with said workpiece, and said rate 
of change information includes velocity information associated with said target point. 

1 5. The method of claim 9, wherein said system has a workpiece and a 
robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between an end 
effector of said robot and a target point associated with said workpiece, and said rate 
of change information includes velocity information associated with said end 
effector. 

1 6. The method of claim 9, wherein said system has a workpiece, a camera 
and a robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between an end 
effector of said robot and a target point associated with said workpiece, and said rate 
of change information includes velocity information associated with said camera. 

17. The method of claim 9, wherein said system has a workpiece and a 
robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between an end 
effector of said robot and a target point associated with said workpiece, and said 
velocity information comprises an angle for each at least one moveable connector of 
said robot and a corresponding time associated with said angle. 

18. The method of claim 1 7, wherein said at least one moveable connector 
has a joint. 

19. The method of claim 1 , wherein said second parameter represents a 
predefined distance threshold. 
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20. The method of claim 1 , wherein said second parameter represents a 
predefined location having a parameter value of zero. 

21 . The method of claim 1 , wherein said first parameter represents a 
S distance between a first point and a second point. 

22. The method of claim 21, wherein said second point is moving and said 
method further comprises the step of adjusting said translation model based upon 
movement of said second point. 

10 

23 . The method of claim 2 1 , wherein said system has a robot and a 
workpiece. 

24. The method of claim 23, wherein said first point is on said robot and 
15 said second point is a target point on said workpiece. 

25. The method of claim 24, wherein said first point is an end-effector on 
said robot. 

20 26. The method of claim 1 , fiirther comprising the step of sensing said 

data. 

27. The method of claim 26, wherein said predefined second parameter is 
any one of the following: a distance, a specific location, a specific temperature, a 

25 temperature range, a specific pressure, a pressure range, a specific volume, a volume 

range. 

28. The method of claim 26, wherein the sensing step employs a visual 
detection system. 
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29. The method of claim 28, wherein said visual detection scheme employs 
at least one camera. 

30. The method of claim 29, wherein said at least one camera is moving. 

3 1 . The method of claim 20, wherein said first parameter represents a 
distance between a first point and a second point and said system has a robot having 
at least one degree of freedom based upon at least one moveable connector, said 
method further comprising the steps of: acquiring at least one image of said first 
point and said second point; producing an error signal from said at least one image, 
said error signal representing a displacement between said first point and said second 
point; producing said translation model as a mathematical dynamic Broyden Jacobian 
update, said mathematical dynamic Broyden Jacobian update comprising at least one 
angle with a corresponding time for said error signal; producing control data for said 
system based upon at least one future error signal derived from a dynamic Broyden 
Jacobian update, said control data comprising said at least one angle and said 
corresponding time information; and adjusting said moveable connector according to 
said control data. 

32. The method of claim 1, further comprising the step of determining 
control data for a controller from said translation model, said controller configured to 
control said first parameter. 

33. The method of claim 32, wherein said control data comprises an 
angular position of a moveable connector associated with said system and a time 
associated with said angular position. 
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34. The method of claim 33, further comprising the step of adjusting said 
moveable connector according to said control data. 

35. A method for controlling a system having at least one degree of 

5 freedom based upon at least one moveable connector so that said system learns how 

to track such that a first point tracks a moving second point, comprising the steps of: 

acquiring at least one image of said first point and said moving second point; 

producing an error signal from said at least one image, said error signal 
representing a displacement between said first point and said second point in said 
10 image; producing a translation model for converting image space coordinates into 

system space coordinates, said translation model having at least velocity information 
pertaining to said first point and said second point; and causing said first point to 
track said moving second point by producing control data for said first point based 
upon at least one future error signal and said translation model. 

15 

36. The method of claim 35, further comprising the step of causing said 
first point to converge toward a predefined distance of said second point. 

37. An apparatus for controlling a first parameter in a system, comprising: 
20 a receiver which receives data that represents a measurement of said first 

parameter in said system; a translator which translates said data using at least rate of 
change information of said first parameter; and a translation model based upon 
translation of said data. 

25 38. The apparatus of claim 37, wherein said translator uses a dynamic 

quasi-Newton algorithm. 

39. The apparatus of claim 37, wherein said translation model includes a 
dynamic Broyden Jacobian update. 
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40. The apparatus of claim 37, wherein said translation model includes a 
dynamic recursive least squares Jacobian update. 

5 41, The apparatus of claim 37, wherein said translation model is created 

without a kinematic model of said system. 

42. The apparatus of claim 37, wherein said translation model includes at 
least velocity information associated with said first parameter. 

10 

43. The apparatus of claim 42, wherein said system has a workpiece and a 
robot having at least one degree of freedom based upon at least one moveable 
connector on said robot, said first parameter represents a distance between a first 
point and a second point, and said velocity information comprises an angle for each 

1 5 at least one moveable connector of said robot and a corresponding time associated 

with said angle. 

44. The apparatus of claim 43, wherein said at least one moveable 
connector has a joint. 

20 

45. The apparatus of claim 43, wherein said first point is an end effector of 
said robot and said second point is a target point associated with said workpiece. 

46. The apparatus of claim 43, further comprising a controller, said 

25 controller producing at least one control signal for controlling said first parameter. 

47. The apparatus of claim 46, wherein said second point is moving and 
translator adjusts said translation model based upon movement of said second point. 
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48. The apparatus of claim 47, wherein said at least one control signal 
adjusts said at least one moveable connector so that said apparatus learns how to 
track and tracks said moving second point. 

49. The apparatus of claim 48, wherein said at least one control signal 
adjusts said at least one moveable connector causing said first point to converge 
toward a predefined distance of said second point. 

50. The apparatus of claim 47, further comprising: a visual detector, said 
visual detector acquiring at least one image of said first point and said second point; 
and an error signal generator producing an error signal fi-om said at least one image, 
each said error signal representing a displacement between said first point and said 
second point. 

5 1 . The apparatus of claim 50, said control signal is based upon at least 
one fixture error signal derived fi-om a dynamic Broyden Jacobian update. 

52. A computer readable medium having a program for a first parameter in 
a system, the program comprising: logic configured to receive data that represents a 
measurement of said first parameter in said system; logic configured to translate said 
data using at least rate of change information of said first parameter; and logic 
configured to generate a translation model based upon translation of said data. 

53. The program as defined in claim 43, wherein said logic configured to 
translate said data uses a dynamic quasi-Newton algorithm. 

54. The program as defined in claim 52, wherein said logic configured to 
generate said translation model includes a dynamic Broyden Jacobian 
update. 
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55. The program as defined in claim 52, wherein said logic configured to 
generate said translation model includes a dynamic recursive least squares 
Jacobian update. 

56. The program as defined in claim 54, further comprising logic to 
include at least velocity information associated with the first parameter. 

57. The program as defined in claim 56, further comprising: 

logic to control a robot having at least one degree of fireedom based upon at 
least one moveable connector on said robot; logic configured to interpret said first 
parameter as a distance between a first point and a second point; and logic 
configured to determine said velocity information as an angle for each at least one 
moveable connector of said robot and a corresponding time associated with said 
angle. 

58. The program as defined in claim 57, further comprising logic generate 
a control signal to control adjustment of said moveable connector of said robot such 
that said first point converges toward to a predefined distance of said second point. 

59. The program as defined in claim 58, wherein said second point is 
moving. 

60. The program as defined in claim 59, further comprising: 
logic to interpret an image fi-om a visual detector, said visual detector 

acquiring at least one image of said first point and said second point; and 

logic configured to generate an error signal from said at least one image, each 
said error signal representing a displacement between said first point and said second 
point. 
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61 . The program as defined in claim 60, wherein said logic configured to 
generate a control signal is based upon at least one future error signal 
derived from a dynamic Broyden Jacobian update. 

5 

62. The program as defined in claim 60, wherein said logic configured to 
generate a control signal is based upon at least one fiiture error signal 
derived from a dynamic recursive least squares Jacobian update. 
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